Sr. Data Engineer & Architect

Pleasanton, CA

Availability:

ASAP

Remote (Preferred)

Professional Background:

● Possesses over 15 years of extensive experience as a data engineer, with a significant emphasis on cloud-based solutions and data architecture.
● Demonstrates strong proficiency in cloud data warehousing and ETL, evidenced by successful migration of 4TB of data from Redshift to Snowflake. Expertise spans Redshift, Snowflake, and SQL Server, enabling effective operation across diverse environments.
● Highly skilled with modern data tools and orchestration, including Airflow, Talend, and Databricks.
● Adept at implementing DBT for dynamic tables and utilizing Snowpipe for streaming data from S3.
● Capabilities extend to real-time data processing and integration, having captured high-frequency data in BigQuery and leveraged Kafka for real-time data into Google Big Table. Established numerous API integrations with third-party vendors such as Salesforce, SAP, and Workday.
● Proponent of robust data governance and CI/CD implementation, successfully deploying version control and data governance frameworks across multiple organizations. Established CI/CD release frameworks utilizing GitHub and Jenkins.
● Explored advanced analytics and AI/ML applications, including development of agents and chatbots on Gen AI.
● Created RAG (Retrieval Augmented Generation) and fine-tuned models for automated code generation